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Fig. 2 




INPUT NEW MPEG-2 FILE AND 
CREATE REDUCED-QUALITY 
MPEG FILE AS AVAILABLE 
RESOURCES PERMIT 




YES 



NO 




YES 



BROWSE THROUGH 
REDUCED-QUALITY 
MPEG FILE TO SELECT 
IN-POINTS AND 
OUT-POINTS OF CLIPS 
TO BE SPLICED 



56 



STREAM COMPRESSED 
VIDEO FROM REDUCED 
QUALITY MPEG FILE 



60 



NO 



STREAM ORIGINAL QUALITY l-FRAMES 
AND 3 FREEZE FRAMES PER l-FRAME 




STREAM ORIGINAL 
QUALITY MPEG-2 
CODED VIDEO 



SELECT 1 OR 2 FREEZE FRAMES PER 
l-FRAME FOR DESIRED SPEED-UP 



62 



STREAM REDUCED-QUALITY l-FRAMES 
AND INSERTED FREEZE FRAMES 
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C MPEG SPLICING ) 



INPUT DESIRED END FRAME OF FIRST CLIP AND 
DESIRED START FRAME OF SECOND CLIP 



121 



FIND CLOSEST I FRAME PRECEDING DESIRED START 
FRAME TO BE THE IN-POINT FOR SPLICING 



— 122 



ADJUST CONTENT OF THE FIRST CLIP NEAR THE END 
FRAME OF THE FIRST CLIP AND ADJUST CONTENT OF 
THE SECOND CLIP NEAR THE IN POINT IN ORDER TO 
REDUCE PRESENTATION DISCONTINUITY AND PREVENT 
DECODER BUFFER OVERFLOW WHEN DECODING 
THE SPLICED MPEG STREAM 



— 123 



RE-FORMATTING INCLUDING RE-STAMPING OF 
PTS, DTS AND PCR'S FOR AUDIO AND VIDEO 



C END ) 

Fig. 3 
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( SEAMLESS VIDEO SPLICING ) 



141 



ANCHOR THE FIRST DTS OF THE SECOND CLIP 
AT ONE FRAME INTERVAL LATER THAN THE 
LAST DTS OF THE FIRST CLIP TO PREVENT 
VIDEO DECODING DISCONTINUITY 



DOES 

142 ^ THE PCR 

EXTRAPOLATED TO 
THE BEGINNING FRAME OF THE 
SECOND CLIP FALL JUST 
AFTER THE ENDING 
TIME OF THE FIRST 
CLIP 
? 

NO 



YES 



ADJUST THE CONTENT OF THE 
FIRST CLIP SO THAT THE PCR 
EXTRAPOLATED TO THE 
143— H BEGINNING FRAME OF THE 
SECOND CLIP FALLS JUST 
AFTER THE ENDING TIME OF 
THE FIRST CLIP 



C END ) 



Fig. 4 
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VIDEO SPLICING 



DETERMINE THE LAST DTS/PTS OF THE FIRST CLIP 

( DTS L 1 ) 



— 151 



DETERMINE THE TIME OF ARRIVAL ( Te ) 
OF THE LAST BYTE OF THE FIRST CLIP 



— 152 



ADD ONE FRAME INTERVAL TO DTS L 1 
TO FIND THE DESIRED FIRST DTS 
LOCATION FOR THE SECOND CLIP 
( DTSfi =DTS L i +1/FR ) 



— 153 



KEEPING THE DTS-PCRe RELATION UNALTERED 
FOR THE SECOND CLIP, FIND THE TIME INSTANT 
Ts AT WHICH THE FIRST BYTE OF THE SECOND 
CLIP SHOULD ARRIVE 
(T START =DTS F 2 -PCR e 2 ) 

(Ts =DTSfi -T start ) 
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YES 

^158 



OPEN UP A CERTAIN AMOUNT OF SPACE 
IN THE FIRST CLIP TO ACHIEVE 
8 

T S =T e + 

BIT RATE 

THE NUMBER OF BYTES TO DROP IS 

„ ( T e - Ts ) ( BIT RATE ) 
1 + 

8 

IF POSSIBLE, REMOVE NULL PACKETS TO 
DROP THE BYTES, OTHERWISE, REPLACE 
ONE OR MORE FRAMES AT THE END OF 
THE FIRST CLIP WITH CORRESPONDING 
REDUCED-QUALITY FRAMES. 



159 — 



CONCATENATE 
THE STREAMS 



160 — 



COMPUTE THE VIDEO TIME 
STAMP OFFSET V offset 



< END ) 
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( TRICK MODE AUDIO ALIGNMENT ) 



172 



176 




YES 



YES 



YES 




NO 




175 



BEGIN NEXT APU 



174 



INCREMENT 
APU POINTER 



ADVANCE APU POINTER TO THE FIRST 
APU BEGINNING IN THE DURATION OF 
THE VPU OF THE l-FRAME IN THE 
ORIGINAL MPEG-2 STREAM 
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( TRICK MODE STREAM) 



181 



INPUT MPEG-2 TS FROM 
WHICH A TRICK MODE 
CLIP WILL BE EXTRACTED 



182 



VIDEO ELEMENTARY STREAM 
( VES ) EXTRACTED 



184 



I FRAME EXTRACTION AND 
VALID PES FORMATION 



185 



SNR SCALING OF THE 
l-FRAMES-ONLY PES 



186 



FREEZE P FRAME INSERTION 
AND VALID PES FORMATION 







TS STREAM GENERATION BY 
MULTIPLEXING THE ABOVE 
VIDEO PES INTO A SYSTEM 
INFO (SI) AND AUDIO PES 
CARRYING TS SKELETON 



183 



AUDIO ELEMENTARY STREAM 
(AES ) EXTRACTED 



187 



SELECTION AND CONCATENATION 
OF THE APPROPRIATE AUDIO ACCESS 
UNITS (FROM THE ORIGINAL ASSET) 
BASED ON THE STRUCTURE OF THE 
VES IN THE TRICK MODE CLIP AND 
VALID PES ENCAPSULATION AROUND 
THESE AUDIO ACCESS UNITS 



( END ) 

Fig. 10 
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( MPEG SCALING j 



221 




■222 



REMOVE DCT COEFFICIENTS 
FOR SPATIAL FREQUENCIES 
IN EXCESS OF THE NYQUIST 
FREQUENCY FOR THE 
DOWNSAMPLED VIDEO 



NO 



YES 




NO 



■225 




RETAIN UP TO A CERTAIN NUMBER OF 
LOWEST-ORDER AC DCT COEFFICIENTS 
FOR EACH BLOCK AND REMOVE ANY 
ADDITIONAL AC DCT COEFFICIENTS 
FOR EACH BLOCK 



■227 



RETAIN UP TO A CERTAIN NUMBER OF 
LARGEST MAGNITUDE AC DCT 
COEFFICIENTS FOR EACH BLOCK 
AND REMOVE ANY ADDITIONAL AC 
DCT COEFFICIENTS FOR EACH BLOCK 



229 



RETAIN UP TO A CERTAIN NUMBER 
OF AC DCT COEFFICIENTS THAT 
DIFFER IN MAGNITUDE FROM UP 
TO THAT NUMBER OF LARGEST 
MAGNITUDE AC DCT COEFFICIENTS 
BY NO MORE THAN A CERTAIN LIMIT 



Q RETURN ) 



Fig. 13 
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( FDSNR-LP ) 



PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC. 



— 241 



LET L=0 — 242 



■243 



PARSE THE NEXT (RUN, LEVEL) EVENT VLC. 



244 




■245 



YES 


COPY 






VLC 





246 



NO 



LET R= RUN LENGTH OF ZEROES FOR 
THE CURRENT (RUN, LEVEL) EVENT 



247 




■248 



YES 



COPY EOB 
MARKER 



251 



NO 




■253 



YES 



COPY 
VLC 



254 — 



COPY EOB 
MARKER 



249 — 



PARSE UNTIL THE END OF THE NEXT EOB 
MARKER IN THE INPUT BIT STREAM 



' " ' Fig. 14 ( RETURN > 
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( FDSNR-LM ) 



PARSE AND COPY THE DIFFERENTIAL 
DC COEFFICIENT VLC 



—261 



PARSE AND DECODE ALL ( RUN, LEVEL ) 
EVENT VLC S UNTIL AND INCLUDING 
THE FIRST EOB MARKER 



—262 



TRANSFORM THE QUANTIZATION INDICES 
TO QUANTIZED COEFFICIENT VALUES 



—263 



SORT THE COEFFICIENTS IN DESCENDING 
ORDER OF THEIR MAGNITUDES 



—264 



KEEP THE FIRST K COEFFICIENTS OF THE 
SORTED LIST AND SET THE LAST 63-K 
COEFFICIENTS OF THE SORTED LIST TO ZERO 



—265 



APPLY ( RUN, LEVEL ) EVENT FORMATION AND ENTROPY 
ENCODING TO THE NEW SET OF COEFFICIENTS 



—266 



COPY THE RESULTING VLC s TO THE OUTPUT 
UNTIL AND INCLUDING THE EOB MARKER 



— 267 



(" RETURN ) 



Fig. 15 
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( SORT K FROM N ) 



O —281 



■282 



GET NEXT COEFFICIENT 
FROM INPUT STREAM 



283 




EOB 

7 



YES 



284 



NO 



( RETURN ) 



287 



SORT THE 
LIST OF K 
COEFFICIENTS 
BY MAGNITUDE 




NO 



YES 



■285 



PUT COEFFICIENT 
INDEX AND MAGNITUDE 
INTO SORT LIST 



i + 1 



— 286 



Fig. 17 
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COEFFICIENT 
MAGNITUDE > MAGNITUDE 
AT END OF LIST 

9 



YES 



(D>— V 


NO 


GET NEXT COEFFICIENT 
FROM INPUT STREAM 


1 


r 



289 



NO 



290 




( RETURN ) 



■291 



REMOVE ENTRY AT THE 
END OF THE LIST 



■292 



BINARY SEARCH FOR RANK 
POSITION OF CURRENT 
COEFFICIENT 



■293 



INSERT CURRENT 
COEFFICIENT INDEX AND 
MAGNITUDE INTO THE LIST 
AT THE RANK POSITION 
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APPROXIMATE 
SORT K FROM N 



311 



CLEAR HASH TABLE 



■312 



GET NEXT 
COEFFICIENT FROM 
INPUT STREAM 



313 




EOB 

9 



YES 



316 



2M _1 
K 



317- 



INDEX HASH 
TABLE WITH i 



318 



NO 



314 




YES 



STRIP HASH TABLE 
INDEX FROM MSB S 
OF COEFFICIENT 
MAGNITUDE 



315 



INSERT COEFFICIENT 
INDEX ON HASH 
LIST OF INDEXED 
HASH TABLE ENTRY 



■321 



GET NEXT ENTRY FROM 
HASH LIST AND PUT 
COEFFICIENT IN THE 
OUTPUT STREAM 



Fig. 19 
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MODIFIED 
FDSNR-LM 



331 



FIND UP TO k LARGEST MAGNITUDE NON-ZERO 
AC DCT COEFFICIENTS (i.e., THE "QUALIFYING 
COEFFICIENTS") FOR THE BLOCK 



■332 



■337 



BEGIN (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER, USING THE SECOND 
CODING TABLE (TABLE 1) 



CONTINUE (RUN, LEVEL) 
CODING OF THE QUALIFYING 
COEFFICIENTS IN SCAN 
ORDER USING THE SECOND 
CODING TABLE 




IF POSSIBLE, INCLUDE A NON-ZERO, 
NON-QUALIFYING AC DCT COEFFICIENT 
IN THE (RUN LEVEL) CODING TO 
ELI MINATE THE ESCAPE SEQUENCE 

^335 




YES 



"'■ ( RETURN ) 

Fig. 20 
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( ATTEMPT ELIMINATION OF ESCAPE SEQUENCE ) Fig 21 



■341 



IDENTIFY THE FIRST QUALIFYING 
COEFFICIENT AND THE SECOND 
QUALIFYING COEFFICIENT 
CAUSING THE ESCAPE SEQUENCE 



■342 



LOOK FOR A NON-ZERO, 
NON-QUALIFYING AC DCT 
COEFFICIENT BETWEEN THE 
FIRST AND THE SECOND 
QUALIFYING COEFFICIENTS IN 
THE SCAN ORDER SEQUENCE 






NO S RETURN 




UNSUCCESSFUL 


344-^ , 




(RUN, LEVEL) CODE THE NON-ZERO 


NON-QUALIFYING COEFFICIENT 


345-^ J 





) 



ESCAPE 
SEQUENCE 
? 

NO 



YES 



■346 



(RUN, LEVEL) CODE THE SECOND 
QUALIFYING COEFFICIENT, 
USING THE NEW RUN LENGTH 



347 




YES 




NO 



SEARCH FOR 
ADDITIONAL NON-ZERO 
NON-QUALIFYING 
COEFFICIENTS THAT 
WILL ELIMINATE THE 
ESCAPE SEQUENCE 




SELECT THE 
NON-QUALIFYING 
COEFFICIENT GIVING THE 
SHORTEST OVERALL 
CODE LENGTH AND/OR 
THE LARGEST MAGNITUDE 
FOR THE BEST PSNR 



RETURN 
SUCCESSFUL 



3 



l_ 



19/33 



C MPEG SCALING ) 



9, QSF— 2 —361 



362 



Fig. 22 
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INTRA 
VLC - FORMAT 
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YES 



READ IN TABLE O READ IN TABLE 1 
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( RETURN ) 
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366 



APPLY MODIFIED FDSNR-LM PROCEDURE, USING 
ADJUSTED QUANTIZER SCALE INDEX IF LESS THAN 
THE MAXIMUM POSSIBLE QUANTIZER SCALE INDEX 
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YES 
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369 




YES 
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QSF 



QSF x 2 
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376 



ATTEMPT RE-CODING FOR LAST 
SLICE USING ADJUSTED QUANTIZER 
SCALE AND SELECT NEW CODING OR 
CODING THAT GIVES BEST RESULTS 




NO 



YES 



377 



YES 



380 




YES 



■378 



k-1 




YES 



381 



k+1 



NO 



382 

NQ ^BACKTRACK" 



383 



ATTEMPT RE-CODING FOR LAST 
SLICE USING ADJUSTED k VALUE 
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GOP= I 
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FILE 
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1- Play from start 1 sec 

2- Pause 

3- Fast Forward to 29 min 

Fig* 26B 5 _ p| ay ! sec 

6- Pause 

7- Fast Reverse to 1 sec 

8- Pause 

9- Play Normal 
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WRITE 


COPY OF THE ASSET 
WITH ALL THE DATA 


EMPEG2 


EMPEG2 


COPY ONLY THE 
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Fig. 27 
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542 



PARSE VIDEO FRAME 
TO 8 x 8 DCT BLOCKS 



543 „ 

DETERMINE DCT COEFFICIENT BIT 
RATE REDUCTION FACTOR (RF) 



544 



GET FIRST BLOCK 




NO 



0 Fig- 33 
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0 



561 



SCALE THE ORIGINAL BLOCK SIZE 
(BS) BY THE REDUCTION FACTOR 
(RF) TO COMPUTE A DESIRED 
NUMBER OF BITS (DNB) FOR 
THE REDUCED BLOCK SIZE 



DNB 



RF*BS 



562 



BORROW BITS 
FROM THE BUCKET 



NBB 
BUK 



BUK/ (NB-J) 
BUK-NBB 



563 



CALCULATE THE NO. OF BITS 
AVAILABLE (NBA) FOR ENCODING NON- 
ZERO AC DCT COEFFICIENTS FOR 
THE REDUCED BLOCK 



NBA 



DN + NBB 



564 



0 



GET THE FIRST NON-ZERO 
AC DCT COEFFICIENT IN 
THE PARSING ORDER 



576 



GET THE NEXT NON-ZERO 
AC DCT COEFFICIENT IN 
THE PARSING ORDER 



565 



DETERMINE THE NO. OF BITS (NBC) 
FOR ENCODING THE COEFFICIENT 



Fig. 34 
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NO 



573 



YES 



TRANSFER THE COEFFICIENT TO 
THE REDUCED-RATE MPEG DATA 



574 



DECREMENT THE NUMBER OF 
BITS AVAILABLE (NBA) FOR 
ENCODING BY THE NUMBER OF 
BITS FOR ENCODING 
COEFFICIENT (NBC) 
NBA NBA-NBC 



575 



MORE 
NON-ZERO AC DCT 

.COEFFICIENTS. 
? 



NO 



YES 



[mJ 



■572 



PUT THE REMAINING 
UNALLOCATED BITS 
INTO THE BUCKET 
BUK-* BUK + NBA 
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Fig. 35 
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DETERMINE THE COEFFICIENT BIT RATE REDUCTION 
FACTOR (RF) FOR A REDUCTION FROM AN MPEG 
SOURCE HAVING AN UNKNOWN OR VARIABLE BIT RATE 



DETERMINE VIDEO FRAME SIZE IN BITS (VS) — 591 



DETERMINE A MOVING AVERAGE VIDEO FRAME SIZE 
OVER THE LAST N FRAMES (VAVS) 



— 592 



CALCULATE A TARGET AVERAGE VIDEO FRAME SIZE 
(VR AVS) FROM AN ACCURACY RATE CONTROL FACTOR 
(AR), THE DESIRED REDUCED RATE (BR) OF THE REDUCED- 
QUALITY MPEG DATA, AND THE VIDEO FRAME RATE (FR) 

VRAVS= AR * BR/FR 



— 593 



DETERMINE NO. OF BITS (BS) IN THE FRAME THAT ARE 
NOT BITS OF THE AC DCT COEFFICIENTES 



— 594 



COMPUTE THE COEFFICIENT BIT 
RATE REDUCTION FACTOR (RF) 

RF= VRAVSA/AVS 



— 595 



( RETURN ) 

Fig. 37 
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